DOCOMENT RESOME 



ED 108 623 

AUTHOR 
TITLE 

INSTITOTIpN 

REPORT NO- 
PUB 'DATE ' 
NOTE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



IR 002 139 

Flburnoyr* Nancy 

Collection of IMS Time Evaluation Data*- 

Southwest Regional Laboratory for Educational 

Research and -Development ^ Los Alamitos^ Calif. 

SWRL-TN-5-7'2-24 ^ ' 

17 Apr 72 ' • \ - 

16p. 

MF-$0.7g HC--$1.58 PLUS POSTAGE 

Computer Programs; ^Data Collection; Data Processing; 
Electronic Data Processing;. Evaluation; Flow Charts; 
*Fo'rmati ve Evaluation ; Information Processing ; 
Information Storage ; Information Systems; *fl^nagement 
Systems; Recordkeeping.; *Studeiit Records; ^Systems 
Development : 
IMS; ^Instructional Management System; Time 
Studies 




ABSTRACT 

Some of the schools participating in t he "SiDjithwest 
/Regional Laboratory's Instructional Management System (IMS) pilot 
' test submitted input data forms to and received processed in.fofmation 
from regional processing and data collection centers. To de.termine 
the feasibility of alternative methods of data collection and output 
return> evaltuative data were collected at the time each set of data 
^^lere deli'verled to the centers. Described in this document are the 
procedures for the completion of the evaluation forms* Sample forms 
together with, a flowchart of the \ IMS operation as a whole are 
included^ (DGC) , , 
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^ ABSTRACT 
Three sites through which IMS student materials pass have been identified 

t 

as Processing and Data Collection Stations, These are (1) the Forms 
Control Station (FCS) where scannable data sheets are received from the 
schools and manually prcjprocesS^ed under ComSys 1 and 2 Input Modes and 
where reports and other compute^ system output are postprocessed; (2) 
the Scanner Station where the Source Scan Tape is made; and (3) the 690 
Station vmere the Source Scan Tape is further processed, and data trans- 
mission to and from the central computing facility is accomplished. 
This document describes each of the time variables for which data is 
to be collected as the IMS pupil material is processed in these three 
Stations* * * « 
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COLLECTION OF IMS TIME EVALUATION DATA 

. Introduction 

Under ComSys 1 and 2 operation procedures there are three Pro- 
cessing Stations (the Forms Control Station, the Scanner Station, and 
the'690 Station). Therefore, in order to monitor the time efficiency 
of the whole system, individual operation times of each Station must 
be monitored as well. By analyzing total processing time in terms of 
shor^ time intervals composing the whole, problems in the System can 
be pinpointed and dealt with at their source. 

Doug Aims (TN 5-71-25) describes processing time in interval 
segments small enough to account for a single identifiable processing 

step. The measurability of each time interval was considered and their 

j ^ " ' 

value in terms of their evaluative/ and predictive information was 
weighed against their ^avai'lability in terms of the time and cost involved 
in their collection and recording* A reduced list of times to be mea- 
sured was established based on these considerations by combining some 
processing steps. 

Collection of Measurements ' 

■ — _ ■ < 

The time intervals and the time variables composing them are 
collected on two separate logs and cross-referenced by the Run Number 
(a sequential number assigned to a batch of pupil data processed in a 
unit). This batch of pupil scores comp9ses an IMS Data Run, and is dis- 
tinguished from a computer run since one' Data Run may require more than 
one computer run if complications occur. A Maintenance Run is defined 
\ 
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as one in which art entire class roster is added to the Pupil Data Base 
Tape or individual pupil records on the Pupil Data Base Tape are 
altered. 

The first log, IMS RUN CONTROL SHEET-I (Attachment 1), contains 
tine identification for each class unit in the Data or Maintenance Run 
and all tim^ measairGments which vary by school class. The second log, 
IMS RUN CONTROL SHEET-II (Attachment 2), contains all time measurements 
to be collected which are constant over all school class units in the 
Data Run. All data for the former are recorded in the Forms Control ^ 
Station during preprocessing, while some data for the latter are recorded 
in each of the three Stations. A flow chart of the data collection pro- 
cedures was abstracted from TN 5-72-03, Figure 6: "Response Sheet ^ 

\ * 
Processing" and is found in Attachment 3. 

Those variables to be keypunched for evaluation of IMS processing 

are so indicated by their accompanying column nttmbers. Tn and DTn refer 

to the nth time variable and the nth time interval recorded, respectively, ^ 

' during Ii«lS processing. 

\ 

IMS RUN CONTROL SHEET-I: Description of Data 

As^pupil data is received (via ComSys 1 or 2) in the Forms Con- 
trol Station (PCS) the following information is recorded, on MS RUN 
CONTROL SHEET-I. 

Coliunns / 

I IMS Run Type : The following codes are assigned to each 

run type: "1" for a Data Run, "2^' for a Maintenance Run. 
For run type 2 only the first 21 columns of IMS RUN CON- 
TROL SHEET-I are to be filled out and then only when pertinent. 
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IMS Run Number : A sequential numbering of a batch of data 
which will be processed as a unit. Scan forms, error data, 
and the various computer printouts are to be coded manually 
with this number for cross-referencing and for filing. 

Ca^d Number : A sequential numbering of the school classes 
assigned to' a given Run. 

ComSys Mode In r Code "1" for main mode input; "2." for 
courier mode input; "3" for scanner mode input; and "4" 
for teletype mode input. 

.* 

Class ID : Class, District, School, Teacher, Program, and 
Grade are coded into six 2~digit numbers. These are read 
''of f . each cover sheet with the- aid of a coded template. 

Unit Number : A 2-digit code ranging from 1 to 10 or 15 
depending on the program of instruction. 

Date' of Test (Tl): Month, day, and year oJE test are taken 
from the cover sheet for each class unit. If missing, date 
is estimated and so indica^ed^Jjv Column 36. 

Date- Data Leaves Site (T2): Tor mail mode input, T2 is the 
month and day of the postmark on the received envelope; for 
courier mode input, T2 is month and day of pickup; for other 
input modes, T2 is the s^ame as data is received which is 
to be recorded in the 690 Station. 

Time Data 'Leaves Site (T3): This field is blank for mail 
mode input; and logged by courier for courier mode input.. 

Date Data Arrives at FCS (t4) : Month and day for mail' and 
courier mode input. T4 equals T2 for other input modes. 

Time Data Arrives at FCS (T5) : Time of mail delivery or 
time courier returns, measured in hours and minutes. Field 
is blank for other input modes as data arrives at the 690 
Station. 

DTI (T2-T1) is the time interval between "Tiirie of Test" and 
"Time Data Leaves Site,^* measyring delay time; between testing 
and onset of transmission to FCb in days. 1 

DT2 (T4-T2) is the time interval between "Tinie Data Leaves 
Site" and "Time Data Arrives at FCS," measuring transmission 
time from the school or district site where data is mailed 
to FCS in days for mail mode only. 
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Columns 

A 

32-34 DT3 (T5-T3) is Che time interval between "Time. Data Leaves 

Site" and "Time Data Arrives at FCS ," measuring transmission 
time from the school or district site to FCS in minutes for 
input modes other than mail* ^ 

36 Record "1" if date missing on ID sheet. 

38 Record "I" if some or all data must be reprocessed. 

\^ _ _ j_ 

Also7"in the Forms Control Station, the Run Number is to be 
recorded on IMS RUN CONTROL SHEET7II in columns 2-4 which then accompanies 
the scan sheets to the Scanner Station for further ^processing. 

IMS RUN CONTROL SHEET-II: Description of Data ^ 

The^ following information will be entered on IMS RUN CONTROL 
SHEET-Il as the data passes through each processing Station. 

.. -Columns 

1 IMS Run Type : Assign the following codes to each run type: 

"1" for a Data Run, "2" for a Maintenance Run. 

2-4 IMS Run Number : Number assigned at the Forms Control 

• Station, matchijig that in columns 2-4 on IMS RUN CONTROL 
SHEET-I. ^' 



Scanner Station 
Columns 

Operator Name : Signature or initials identfying scanner ' 
operator for this Run. 

5-6 

7 Number of Scan Reruns : Numbers of times the data set com- 

prising a Run must be rescanned due to teacher or system 
errors or problems. 
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Columns 



Mo/Da: Date of scanner operation for this Run recorded 
as 2-digit numbers. If scanning must be repeated, additional 
.dates are* noted. ' . 

Source Scan Tape Number : Same number as labeling the Source 
Scan Tape which is created from the raw pupil data on scannable 
sheets. 

Scanner Time On (T6): Initial operation time measured in 
hours and minutes for first and second scanning. If data 
must be scanned more than twice, times for additional scan- 
nings are to be attached. 

Scanner Time Off (T7) : Final operation time measured when 
all forms for this Run have been run in hours and minutes.; 
Times for additional runs are to be noted as for T6. 

Scanner Operaiting Time : T6 subtracted: from T7 measures 
elapsed scanner operation time in hours drid minutes. This 
time will be converted to minutes and recorded as DT5 in the 
Forms Control Station. If more ,than two scannings have 
been made, the average operation of time is to be recorded 
and this average will be DT5. 

Ccmment on any happenings which may have affected the times 
above (e.g., machine failure) are to be noted. 



690 Station 
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Columns 



Scan Tape Processor : Signature or initials identifying 690 
operat6r using OPSN''<^ to convert data from the Source Scan 
Tap.e to ttie Scores Data Input Tape. 

Number of Processing Reruns : Number of times after the first 
that a Source Scan Tape must be pro^ssed by OPSN. 

Mo/Da : Date of OPSN data conversion. If more' than Dne OPSN 
run is performecj, their dates are also recorded. 

Scores Data Input Tape Number : Same as labeling the Scores ** 
Data Input Tape. The data on this tape was converted from 
the Source Scan Tape and is ready for Remote Job Service (RJS) 
to the. central computing facility for IMS processing. 

RJS Operator : Signature or initials identifying RJS operator. 



The program OPSN is currently being documented. 
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Columns 

9-10 Number of transmission Failures : Count of unsuccessful , 

transmi^'ssion attempts for' the Run. If greater than 99, 99 
is recorded. 

Mo/Da Date of RJS run is recorded in two 2-digit numbers. 

If RJS is run more than once, corresponding dates are recorded, 

^ Time Line Up (T8) : Onset of transmission from the 090 to 

the central computing facility, recorded only for the success- 
ful transmi^ssioh occurrence in hours and minutes. 

Report Output ^Tape EOF Time (T9): Time of the completion 
of report output print .to tape,- recorded in hours and 
minutes, 

Report Output Tape Nipnber : Same as labelii]^g the Report 

Output Tape which is created by processing the Scores Data 
Input Tape. 

'Comments on any happenings which may have affected the times- 
.above are to be noted. • - ^ 

Forms C ontrol Station 

^ 

Colimins 

Post-Processor : Signature or initials identifying who post- 

^ processes system messages and teacher reports. 

Mo/Da: Date system messages. and teacher reports are received 

at the Forms Control Station for postprocessing, recorded 
as two 2-digit numbers. 

Time Postprocessing begins (TlO)- Time measured in hours 

nnd minutes. 

Input Queue Time (Til): Time following "IN AT" on the top 
line of front sheet of computer output as three 2-diglt num- 
bers, measured in hours., minutes, and seconds. If Run is to 
be reprocessed, additional times are noted". 



Exec. Time (T12): Time computer execution begins is takea \ 
from the last line of letters and digits before "SWRL" on \ 
front sheet of computer output as three 2-digit nunibers 
measured in hours, minutes, and seconds, - • ♦ 



/ 

/ 



\ 
\ 

Columns 

11-15 

16-18 
19-23 

24-25 

26-31 
32-35 

36-40 
41-42 
43-37 
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Output Queue Time (T13) : Time on the same line as Input- 
Que.ue Time except following "OUT TO... AT" on output, measured 
in lio'urs, minutes, and seconds. 

DT4 (T6~T4 & T5) : Time interval between the latest time 
r^ip^rded under ''Time Data Arrives at FCS" in IMS RUN CONTROL 
SHEET-I and '*Time Scanner On," measuring preprocessing and 
the time scanner operation begins in minutes. 

DT5 (T7-T6): Time interval between ''Time Scanner On" and 
"Time Scanner Off" measuring scanner operation time in 
minutes. 

DT6 (T8-T7):; Time interval between '^Scanner Time Off" and 
onset of data transmission from the 690 to the central com- 
puting facility, "Time Line Up". measuring time OPSN takes 
to process the Source Scan Tape plus any delay time* between . 
the Scanner Station and 690 transmission in minutes.- 

DT7 CT11-T9): Time interval between "Time Line Up^' and 
"Input Queue Time," measuring the transmission from the 690 
to the central computing facility in minutes, - / 

DT8 (T12-T11): Time interval between "Input Queue Time" and 
"Exec. Time," measured in seconds, 

DT9 (CPU Time) : Seconds recorded from s^e line of computer 
output as "Exec. Time" found, preceding "SEC," on the front 
page of the computer output. 

DTIO (T13-T12): Time interval between "Exec. Tima" and 
"Output Queue -Time measuring the total execution tinje 
including DT9 and any delays caused internally by compii^ter 
processing control in secondsl 

DTll (T9-T13): Time interval -between '^Output Queue Time," 
and "Time Print Complete," measuring return transmission 
time' from CCN to the 690 including any delay time in output 
queue in minutes. 

DT12. (T10-T9): Time interval between "Time Print Complete" 
and "Time Postprocessing Begins," measuring the delay time 
between end-of-return transmission from CCN and beginning of 
postprocessing in the Forms Control Station in minutes. 

Ho/Ds: Dade reports mailed, postprocessing complete, 
measured as two 2-digit numbers. 
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Columns 

Time Postprocessing Complete (T14) : Time reports prepare,d 

for deposit in mail bin, measured in hours and minutes. 

DT13 (T14-T10): The time interval betweeh "Time Postpro- 
^ cessing Begins" and "Time Postprocessing Complete" measured 

'^.^ in minutes. 

52-54 DT14 (T44-T4) : Total processing time in days. 

When time intervals measured extend over days, only the working 
hours in a day are considered. At present this is 8:00-12:00 a.m. and 
1:00-5:00 p.m. For ex^ple, if end of transmission frc5n the central 
computing facility to the 690 is 4:10 on 2/05 and postprocessing begins 
at 10:30 on 02/06, then the time interval T12 is 200 minutes: 50 minutek 
on one day plus 150 minutes the next. If the lunch break is taken, so ' 
comment and. sub tract one houj out of the affected time interval. Include 
all other delays and breaks as p&t of the operation time interval being 
measured. 
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Attachment 2 



IMS RUN CONTROL SHEET^- II 



Scanner Station 



/ 



IMS RUN 
TYPE NUMBER 



2-4 



Operator Name 



Number of Scan 
Reruns 



D 



Date 



Mo . Day 



Scanner Time On (T6) 
Off (T7) 



iSt „ 

1 . Run 



Source Scan "Tape. <No 



2 Run 



"7^ 
AVERAGE 



Operating Time, '<T7-T6) 



/ 



" \ - 



Hrs. Min. 



Conments : 



Hrfsl Min. 



Hrs.' I^lin. 



/ 



690 Station 



Scan Tape Processor 



Numbe.r of Processing Reruns 



Date 



Mo, 



Day 



RJS Operator 



Date 



/ 



Mo. Day 

Time Line Up (T8) 

Report Output 
/ Tape EOF Time (T9). 



Scores \Data Input Tape No. 
Pupil Data Bas(k Tape No. IMS DB 

\ 

Number of Transmission 

XFailures 



Report Output Tape No. 



Hrs, Min. 



9-10 



Comments : 
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^ Attachment 2 (continued) 



Forms Control Station 
Post-processor 



Date 



/ 



♦ Mo. Day 

Time post-processing begins (TIO) 

y 

* , ' Inpujt Queue Time (Til) 

Exec. Time CT12) 

/ 

Outl5irf Queue Time (T13) 

- ' \ 



Postprocessing begins 



iSt 

1 RUN 



2 RUN 



Hrs. Min. Sec/ Hrs. Min. Sec. 



DT4 



Min. 



(T6-T4+T5 


>) 













11-15 

DT7 
( T11-T8 ) 



Min. 



24-2^ 
DTIO 



Sec, 



u 


1 








36.-4 ( 


3 



Min, 



DT5 
aZzTG) 



16-18 

DT8 



Min. 



^ DTII 
(T9rTI3) 
Min. I I j 

41-42 



Miri. 



Date I Post-processing Complete 
Mo. Day 

Time Post-processrng Complete (T14) 



Min, 



firs.* Min. 



DT6 
(T8-T7). 



19-23 
DT9 



( 


■T12-T11) 




[CPU Time) 


Sec . 














< Sec. 











32-35 
DTI 2 





(T10-T9y 












43-47 





DT13 
(T14 "TK^ 



. Days 



48-51 

DT14 
(T14-T4) 



52-54 



Comments : 
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Attachment 3 



./IMS DATA COLLECTION WITH RESPONSE oHEET PROCESSING 



I. I). 



- Criterion ^Exercl-zj^s^. 



~ Class Iclentif icacion Sheets 



\ 



Scan Sheets 
at 

School Site 



SCHOOL SITE 



4'^ U- 



III 




ComSys II 
Courier 
Time Log 



Start IMS Forms 
iPreproce 
VP^ocedi 



IS Forms 
:essing 1 
lures y 



I 



I 



FORMS COiN^TROL 
STATION ' 



rLog C.E. 
l.D. Scan 
Sheets 
received 



IMS Run Con- 
trol Sh-et-I 




IMS Forms anci 
Procedures 
Error Log 



& l.D. Scar 
Sheets as 



needed 



I 



.Ho Run Con- 
trol Sheet-Il 




Scan Sheets 




_/Begin Sca^ner^ / 
/v^ Procedure//^ 

/ 



SCANNER 
STATION- 



lERiC 



^ OpScan 100 




processing 


H 


1 

B 
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Attachment- 3 (cont'd) 




RJS 
Pupil Data 
transmission 



I 



Central 
Computing 
FacLL-i'ty 
processing 




RJS . 
Report Data 
cransmiss ion 



I 




IMS Reports,/ 
Teacher and 
System Erro.r 
^Records 




. /■ 
ERIC 



1 


690 
process ing 






• — ^ 



690 
Remote IMS 
processing 




Yes 





r 



Pup^LUPerfor- 
mance Reports 
Teacher & Sys.ll. 
Error Rec 




Atiachmenl: 3 (cont'd)- 





/Start of IMS 
l^oscprocessing 
V Procedures 



FORMS CONTROL 
STATION 





/check IMS 
l^-wReports for^ 
/input Error 




Criterion 
Exercises 
Scan Sheets 




Yes 



Prepare 
/IMS Reports/ 
for distri- 
bu t ion 



I 



^ile Copy of 
/IMS Reports^ 
for SWRL 
reference 



/Correct C.Ei 
'& I.D. Scai-^ 
■W Sheets "andi 
'prepare for/ 
Rerun 





ComSys 
f or II 



I 





'Reports 


) ► 


at 




School' Site 



SCHOOL SITE 



ERIC 
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